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ABSTRACT 


This  paper  suggests  several  iconic  image  “warpings”,  or  remappings,  which  facil- 
itate computationally  inexpensive  measurements  of  moving  3-D  points  relative  to  a 
camera.  Assuming  translational  motion  of  the  camera,  where  the  optical  axis  coincides 
with  the  direction  of  motion,  and  a stationary  scene,  points  in  3-D  space  that  lie  on  a 
particular  3-D  surface  produce  a constant  value  for  some  nonlinear  function  of  the  opti- 
cal flow.  This  function  need  not  be  computed  after  the  image  is  formed,  but  rather  can 
be  implemented  by  hardware  at  the  retinal  level,  Le.,  via  non-linear  variable-resolution 
(usually  logarithmic)  retina.  Four  sets  of  different  surfaces  are  introduced  and  there  is 
one  optical-flow-based  constant  value  for  each  surface.  We  call  these  values  "invari- 
ants". An  invariant,  which  is  a scalar,  describes  a 3-D  surface.  For  each  invariant  a 
logarithmic  retina  is  defined  which  will  cause  optical  flow  on  these  surfaces  to  have 
identical  values. 

The  process  of  image  remapping,  called  “normalization”,  is  defined  for  four  1-D 
parameterizations  of  space:  range,  depth,  looming  and  clearance.  For  each  invariant  a 
camera-retina  imaging  OKxlel  utilizing  spherical  projection  and  foveal  peripheral  resolu- 
tion is  described  for  analyzing  optical  flow.  Computer  simulation  demonstrates  how 
the  new  suggested  retinae  normalize  the  optical  flow  with  respect  to  each  one  of  the 
parameterizations. 


This  research  was  supported  in  part  by  a grant  from  the  National  Science  Founda- 
tion to  Florida  Atlantic  University  (Grant  #IRI-9 115939). 
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1.  INTRODUCTION 

This  paper  describes  nonlinear  retinal  mappings  that  simplify  motion  measure- 
ments of  points  in  3-D  space.  Assuming  translational  motion  of  a camera  whose  opti- 
cal axis  coincides  with  the  direction  of  motion  and  a stationary  scene,  points  in  3-D 
space  that  lie  on  a p^cular  surface  produce  a constant  value  of  some  nonlinear  func- 
tion of  the  image  optical  flow.  Four  sets  of  surfaces  are  introduced,  each  of  which 
corresponds  to  one  optical-flow-based  constant  value  (invariant).  This  means  that  the 
nonlinear  function  associated  with  a particular  surface  will  result  in  the  same  value  of 
optical  flow  function  for  all  points  on  that  surface,  independent  of  where  the  points  are 
in  the  image. 

The  nonlinear  functions  of  optical  flow  can  be  implemented  using  multi-resolution 
(usually  logarithmic)  foveal-peripheral  retinae  and  hence  no  con:q)utations  are  required. 
We  list  the  four  different  surfaces  that  correspond  to  the  1-D  parameterizations  of  3-D 
space: 

(1)  Constant  Range  Surface:  This  surface  corresponds  to  points  in  3-D  that  lie  at  a 
constant  range  from  the  camera  pinhole  point,  i.e.,  points  lying  on  a sphere  cen- 
tered at  the  camera  pinhole. 

(2)  Constant  Depth  Surface:  This  surface  corresponds  to  points  in  3-D  which  lie  in 
the  plane  perpendicular  to  the  optical  axis  of  the  camera,  and  are  also  referred  to 
as  constant  time  to  contact  points  [LEE,  RAVTVl]. 

(3)  Constant  Looming  Surface:  Looming  of  a point  is  defined  [RAVIV2]  as  —rlr 
where  r is  the  distance  of  the  point  from  the  observer  and  dot  corresponds  to  the 
derivative  with  respect  to  time.  It  is  a measure  of  an  obstacle’s  collision  threat 
Points  of  constant  looming  lie  on  a sphere  passing  through  the  center  of  the  cam- 
era pinhole  point  The  diameter  of  the  sphere  coincides  with  the  translational 
motion  vector  of  the  camera. 

(4)  Constant  Clearance  Surface:  This  surface  corresponds  to  points  in  3-D  which  lie 
on  a cylinder  whose  axis  coincides  with  the  translational  vector  i.e.,  points  in  3-D 
which  have  a constant  radial  distance  (or  "clearance")  from  the  camera  [RAVIVl, 
ALBUS]. 

The  analysis  takes  place  in  a spherical  (R  0 O)  coordinate  system.  In  this 
representation,  since  we  deal  with  translation  only  along  the  optical  axis,  the  projection 
of  any  3-D  point  in  this  coordinate  system  moves  along  a constant  (|)  radial  line  and  can 
be  processed  independently  of  any  other  point. 

Similar  ideas  have  been  documented  in  a number  of  places,  e.g.,  [WEIMAN, 
FISHER,  MESSNER,  SANDINI],  for  the  “log-polar”  transform.  The  log-polar 
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remapping  is  the  planar  projection  image  "normalized  for  depth". 


2.  SPHERICAL  COORDINATES  AND  PROJECTION  FOR  3-D  SPACE 

In  a rectilinear  motion  with  no  rotation,  points  in  the  image  plane  move  away 
from  the  Focus  of  Expansion  (FOE)  (Hgure  la)  and  towards  the  Focus  of  Contraction 
(FOC)  (Figure  lb).  Based  on  this  observation  we  use  an  /?-6-0  spherical  rather  than  a 
Cartesian  representation  of  points  in  space,  which  reduces  to  a 6-0  representation  in 
the  image  domain. 

Figures  2 and  3 show  the  chosen  coordinate  system  and  the  definitions  of  r and 
the  angles  6 and  <|>.  (Note  that  the  R -0-0  coordinate  system  corresponds  to  the  velocity 
egosphere  defined  in  [ALBUS].)  If  the  optical  axis  coincides  with  the  translational  vec- 
tor, then  in  the  image  domain,  constant  <(>  corresponds  to  a radial  line  that  emerges  firom 
the  FOE  and  a constant  0 corresponds  to  a circle  whose  center  is  the  FOE.  Given  a 
point  in  Cartesian  coordinates,  it  can  be  transformed  to  a (r-6-<|>)  point  in  the 
(/?-0-<I>)  domain  and  vice  versa. 


3.  PROJECTIVE  SURFACE  INVARIANTS 


This  section  summarizes  previous  results  on  the  invariants  [RAVTVl].  For  a 
translational  motion  of  the  camera,  for  any  point  in  space  (except  for  0=0  and  0=jc)  it 
has  been  shown  that: 


V ^ 0 

r sin0 


(1) 


Here,  v is  the  translational  speed  of  the  observer,  and  the  dot  denotes  differentiation 
with  respect  to  time  (See  Fig.  4).  0 is  the  optical  flow  along  a radial  line,  i.e.,  for  con- 

0 

stant  <|).  At  any  point  in  time  v is  constant,  and  hence  the  value  r——  is  the  same  for 

sin0 

all  points  in  3-D  space,  except  those  with  0=0  and  0=7C.  The  values  0 and  0 can  be 
measured/computed  for  a point  in  stationary  3-D  space  at  each  instant  of  time,  and 

0 

hence  the  nonlinear  function can  be  obtained. 

sin0 

The  following  is  a description  of  the  four  invariants  in  terms  of  optical  flow.  The 
derivations  hold  for  all  points  in  3-D  except  those  that  lie  on  the  motion  axis,  i.e.,  with 

0=0  and  0=7C.  We  denote  the  invariants  by  and  They  all  have 

V 

units  of  — : — . Figure  5 is  a summary  of  the  invariants.  It  shows  the  basic  relationship 
tune 

between  space,  speed  and  optical  flow  (top  equation),  from  which  the  four  invariants 
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are  derived.  Based  on  geometrical  properties,  the  time-dependent  invariants  are  shown 
as  a function  of  optical  flow.  The  geometrical  interpretations  of  all  invariants  as  1- 
dimensional  parameterizations  are  shown  at  the  bottom  of  Figure  S. 

1 6 

1.  The  constant  range  invariant  — = . ^ . All  points  in  3-D  space  that  lie  on  a 

Xji  sm0 

sphere  whose  center  is  the  pinhole  point  of  the  camera  share  this  invariant,  i.e., 
have  the  same  Xjf . The  meaning  of  this  invariant  is  that  the  modified  optical  flow 
0 

is  the  same  for  all  points  on  a sphere  (except  those  which  are  on  the  axis 

sinO 

motion  of  the  camera).  Points  inside  the  sphere  ("close"  points)  produce  higher 
0 

values  of and  points  outside  the  sphere  ("far"  points)  produce  smaller  values 

sin0 

0 

of . Hence,  it  is  possible  to  find  to  within  a scale  factor  the  range  of  a point 

sin0 

by  simply  calculating  this  value. 

1 0 

2.  The  constant  looming  invariant  ^ points  in  3-D  space  that  lie  on  a 

sphere  which  lies  in  front  of  the  camera  share  this  invariant,  i.e.,  have  the  same 
X5.  The  sphere  diameter  coincides  with  the  optical  axis  of  the  camera,  and  the 

camera  lies  on  the  sphere’s  surface.  In  this  case  the  diameter  of  the  sphere 

0 

is  constant,  and  so,  using  Equation  (1),  — — remains  constant.  It  has  been  shown 

tan0 

by  [RAVIV2]  that  all  points  on  a particular  sphere  result  in  the  same  visual 
“looming”. 

1 0 

3.  The  constant  clearance  invariant  — = — r— . All  points  in  3-D  space  that  lie  on 

Xc  sin20 

a cylindrical  surface  whose  axis  coincides  with  the  camera  translational  motion 
vector  share  this  invariant,  i.e.,  have  the  same  Xc . 

1 20 

4.  The  constant  depth  (time  to  contact)  invariant  . All  points  in  3-D 

space  that  lie  on  a plane  which  is  perpendicular  to  the  direction  of  motion  of  the 
camera,  share  this  invariant,  i.e.,  have  the  same  Xp.  Xp  is  the  “time  to  contact” 
as  described  by  [LEE].  It  tells  the  animal  how  to  control  its  motion  in  order  to 
avoid  collision. 
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4.  VARIABLE  RESOLUTION  RETINAE 

In  this  section  we  show  how  these  invariants  may  be  exploited  by  an  appropriate 
“retina”  to  normalize  optical  flow.  For  purposes  here,  it  is  immaterial  whether  this 
retina  is  implemented  optically,  as  spatially  variant  receptor  arrays,  or  by  explicit  non- 
linear subpixel  sampling. 

[ORSER]  gives  additional  motivation  as  well  as  describing  a binocular  wire  frame 
scene  simulator  which  gives  simulated  results  for  all  four  retinae. 

For  each  invariant  we  show  the  corresponding  structure  of  the  retina.  Range, 
depth,  looming  and  clearance  normalizations  correspond  to  the  previously  described 
range,  depth,  looming  and  clearance  invariants,  respectively. 


4.1.  RANGE  NORMALIZATION 

Equation  (1)  describes  the  basic  relationship  between  range,  velocity  and  optical 
flow  for  a forward  translating  camera.  First  we  rewrite  it  as: 


sin  6 r 

Another  way  of  rewriting  Equation  (1)  is 

d , , 0 . V 
—\n{tan-r)  = - 
dt  2 r 


(2) 


(3) 


(4) 


When  integrating  both  sides  of  Equation  (2)  (for  fixed  r and  v ) we  obtain: 

, . e , 00  v(i-»o) 

Intan-— -Intan  — = 

2 2 r 

0 

The  meaning  of  Equations  (3)  and  (4)  is  that  a In  (tan^)  retina  will  produce  the 

same  optical  flow  for  all  points  that  lie  at  the  same  distance  from  the  observer,  i.e., 

0 0 

— — — will  be  measured  linearly.  For  the  In  (tan—)  retina,  the  optical  flow  magnitude  is 
sm6  2 

in  a simple  inverse  relationship  to  range. 

We  call  this  remapping  range  normalization,  since  the  magnitude  of  optical  flow 
values  will  be  equal  if  and  only  if  they  are  generated  by  points  having  the  same  range. 

Figure  6a  shows  3-D  points  which  are  at  the  same  range  firom  the  moving 
observer.  The  optical  flow  6 generated  in  the  image  plane  by  these  points  (for  a for- 
ward translating  camera)  is  shown  in  Figure  6b.  Note  that  the  optical  flow  values  vary 
from  one  point  to  another  as  a function  of  radial  angle  0.  However,  the  range- 

0 


normalized  optical  flow  for  these  points 


sin0 


is  identical  for  all  the  points  (Figure  6c) 
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and  is  generated  directly  by  a ln(tan— ) retina. 

If  ^ and  6 are  plotted  against  each  other,  the  resulting  representation  of  the  sphere 
is  called  the  isometric  plane.  Figure  6d  depicts  the  optical  flow  in  this  manner  while 
figure  6e  is  the  range-normalized  optical  flow  using  an  analogous  logarithmic  isometric 
plane  representation. 

The  nonlinear  radial  displacement  as  a function  of  retinal  eccentricity  and  resolu- 
tion elements  per  unit  of  eccentricity  for  the  range  normalizing  retina  are  shown  as  the 
solid  and  dashed  lines  of  Figure  6f,  respectively. 


42.  DEPTH  NORMALIZATION 

Instead  of  keeping  range  r constant,  as  in  the  preceeding  section,  it  may  be  desir- 
able to  keep  depth  (i.e.,  the  projection  of  range  onto  the  optical  axis)  constant  Points 
at  a common  depth  X fiom  the  camera-retina  are  parameterized  by  6 and  in  terms  of 
range  r arc  given  by  : 

X = r cos  e 0^0  ^90°.  (5) 


Hence  by  dividing  Equation  (1)  by  cos  0,  we  get: 

V ^ 1 0 

r cos  0 cos  0 sin  0 

or: 

V 2 



r cos  0 sm  20 

Another  way  of  writing  Equation  (6)  is: 

-^ln(tan0)  = — 
at  r cos  0 

After  integrating  both  sides  of  Equation  (7)  we  obtain: 

In  tan  0 - In  tan  00  = — - — (r  - tn) 

r cos  0 


(6) 

(7) 

(8) 

(9) 


The  meaning  of  Equations  (8)  and  (9)  is  that  a ln(tan0)  retina  will  produce  the 

same  optical  flow  for  all  points  that  lie  at  the  same  depth  — - — from  the  observer, 

rcos0 

0 20 

TT  (which  equals  — r-rr-)  will  be  measured  linearly. 

sin0  COS0  sm20 

For  the  ln(tan0)  retina,  the  optical  flow  is  in  a simple  inverse  relationship  to 
depth. 
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We  call  this  remapping  depth  normalization,  since  the  magnitude  of  optical  flow 
values  will  be  equal  if  and  only  if  they  are  generated  by  points  having  the  same  depth. 

Figure  7a  shows  3-D  points  which  lie  in  the  same  depth  from  the  moving 
observer.  The  optical  flow  0 generated  by  these  points  is  shown  m Figure  7b.  The  nor- 

20 

realized  optical  flow  for  points  in  3-D  with  the  same  range  is  identical  for  all 

the  points  (Figure  7c).  This  value  is  measured  direcdy  by  a In  (tan  0)  retina. 

The  isometric  plane  and  logarithmic  isometric  plane  representations  are  shown  in 
Figures  7d  and  7e,  respectively. 

The  nonlinear  radial  displacement  as  a function  of  retinal  eccentricity  and  resolu- 
tion elements  per  unit  of  eccentricity  for  the  depth  normalizing  retina  are  shown  as  the 
solid  and  dashed  lines  of  Figure  7f,  respectively. 

This  depth  normalization  is  the  spherical  projection  analog  of  the  log-polar 
transform  [WEIMAN,  FISHER]. 


43,  LOOMING  NORMALIZATION 


Spheres  of  constant  looming  have  been  discussed  in  [RAVIV2]  and  refer  to  points 
at  range  r lying  on  a sphere  whose  diameter  is  given  by  r/  cos  0.  Looming  normaliza- 
tion refers  to  the  mapping  of  the  spherical  projection  in  such  a way  that  optical  flow 
values  of  two  points  are  equal  if  and  only  if  they  lie  on  the  same  sphere  of  constant 
looming. 


These  points  of  the  sphere  can  be  parameterized  by  the  reciprocal  of  the  radius  of 
the  sphere  in  terms  of  0 and  range  r as: 

1 cos  0 


radius  of  sphere  r 

Hence  by  multiplying  Equation  (1)  by  cos  0,  we  get: 

V cos  0 ^0 

= cos  0 


0^0  ^90°. 


sin  0 


(10) 


(11) 


or 


V cos  0 . d 0 

at  — — 

r tan  0 

Equation  (11)  can  also  be  rewritten  as: 

. ftx  V COS0 

— In(sin0)  = 

Of  r 

After  integrating  both  sides  of  Equation  (12)  we  obtain: 


(12) 


(13) 
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In  sin  0 - In  sin  00  = ^ - (t  - Iq)  (14) 

r 

The  meaning  of  Equations  (13)  and  (14)  is  that  a ln(sin0)  retina  will  produce  the 

0 

same  optical  flow  for  all  points  that  lie  on  the  same  looming  sphere,  i.e.,  — — will  be 

tan0 

measured  linearly. 

For  the  In  (sin  0)  retina,  the  optical  flow  produced  by  it  has  a simple  direct  rela- 
tionship to  the  looming  sphere  on  which  it  lies. 

We  call  this  remapping  looming  normalization,  since  the  magnitude  of  optical  flow 
values  will  be  equal  if  and  only  if  they  are  generated  by  points  having  the  same  loom- 
ing value. 

Figure  8a  shows  3-D  points  which  lie  in  the  same  looming  sphere.  The  optical 
flow  0 generated  by  these  points  is  shown  in  Figure  8b.  The  normalized  optical  flow 
0 

for  these  points,  — — , is  identical  for  all  the  points  (Figure  8c).  This  value  is  measured 
tan0 

directly  by  a In  (sin  0)  retina. 

The  isometric  plane  and  logarithmic  isometric  plane  are  shown  in  Figures  8d  and 
8e. 

The  nonlinear  radial  displacement  as  a function  of  retinal  eccentricity  and  resolu- 
tion elements  per  unit  of  eccentricity  for  the  looming  normalizing  retina  are  shown  as 
the  solid  and  dashed  lines  of  Figure  8f,  respectively. 


4.4.  CLEARANCE  NORMALIZATION 

In  the  situation  in  which  the  camera-retina  is  translating  along  a straight  line,  the 
prediction  of  obstacles  adjacent  to  this  line  which  it  will  not  “clear”  is  desirable.  The 
locus  of  these  points  for  a constant  radius  of  lateral  clearance  is  a cylinder  whose  axis 
is  collinear  with  the  axis  of  translation.  [ALDUS,  RAVIVl] 

A point  at  range  r will  lie  on  the  cylinder  whose  radius  is  given  by  r sin  0. 

V 

Hence  ^ ^ is  constant  for  all  points  on  the  cylinder,  and  so  by  dividing  Equation 

(1)  by  sin0  we  have: 


r sin  0 sin  0 sin  0 


or 


r sin  0 


dt  = 


sin^0 


dQ 


(16) 
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Another  way  of  writing  Equation  (15)  is: 


(17) 


By  integrating  both  sides  of  Equation  (16)  we  obtain: 


— ?^(^  - ^o)  = -{cot  e - cot  Go) 
r sm  6 


(18) 


The  meaning  of  Equations  (17)  and  (18)  is  that  a cotQ  retina  wiU  produce  the 
same  optical  flow  for  aU  points  that  lie  at  the  same  radial  distance  from  the  moving 
0 

observer,  i.e.,  — — will  be  measured  linearly, 
sin^ 

Note  that  this  retina  is  the  only  one  which  is  not  logarithmic.  However,  it  can  be 
written  as  a logarithmic  one  by  using  the  identity: 


cot  0 = In  ® 


(19) 


The  optical  flow  produced  by  the  cotQ  retina  is  directly  proportional  to  the  inverse 
of  the  radius  of  the  cylinder,  i.e.,  the  clearance  the  object  has  with  respect  to  the  trajec- 
tory of  the  camera. 

We  call  this  remapping  clearance  normalization,  since  the  magnitude  of  optical 
flow  values  will  be  equal  if  and  only  if  they  are  generated  by  points  having  the  same 
clearance  (radial  distance). 

Rgure  9a  shows  3-D  points  which  lie  in  the  same  cylinder  surrounding  the 
observer  (each  point  on  the  cylinder  has  the  same  distance  from  the  translation  axis). 
The  optical  flow  0 generated  by  these  points  is  shown  in  Figure  9b.  Note  that  the  opti- 
cal flow  values  vary  from  one  point  to  another.  However,  the  clearance  normalized  opt- 

0 

ical  flow  for  these  points  — — is  identical  for  all  the  points  (Figure  9c).  This  value  is 

sin^ 

measured  directly  by  a cotQ  retina. 

The  isometric  plane  and  logarithmic  isometric  plane  representations  for  the  unnor- 
malized and  clearance  normalized  optical  flow  is  shown  in  figures  9d  and  9e  respec- 
tively. 

The  nonlinear  radial  displacement  as  a function  of  retinal  eccentricity  and  resolu- 
tion elements  per  unit  of  eccentricity  for  the  clearance  normalizing  retina  are  shown  as 
the  solid  and  dashed  lines  of  Figure  9f,  respectively. 
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5.  CONCLUSIONS 

In  this  paper  we  have  shown  several  retinal  mappings.  They  are  extensions  of  the 
well  Imown  log-polar  retina  as  described  by  [WEIMAN,  SANDINI]  and  others.  Each 
retina  described  in  this  paper  allows  simple  and  direct  measurements  of  a function  of 
optical  flow.  A value  of  this  function  corresponds  to  a 3-D  surface. 
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Figure  la:  OPTICAL  FLOW  RELATIVE  TO  THE  FOCUS  O 
EXPANSION  (FOE) 
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Figure  lb:  OPTICAL  FLOW  RELATIVE  TO  THE  FOCUS  OF 
CONTRACTION  (FOC) 
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Figure  3:  THE  0-<I)  IMAGE  DOMAIN 
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Figure  4:  GEOMETRY  FOR  CONSTANT  «>  RADIAL  LINE 
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Figure  5:  SUMMARY  OF  THE  INVARIANTS 
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Figure  6a:  EQUAL  RANGE  POINTS 
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Figure  6b:  OPTICAL  FLOW  GENERATED  BY  POINTS  WITH 
CONSTANT  RANGE 
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Figure  6c:  RANGE  NORMALIZATION  OF  OPTICAL  FLOW 
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Figure  6d:  ISOMETRIC  REPRESENTATION  OF  OPTICAL  FLOW 
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Figure  6e:  ISOMETRIC  REPRESENTATION  OF 
RANGE-NORMALIZED  OPTICAL  FLOW 


Figure  6f:  LOG  TAN  RETINA  (RANGE) 
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Figure  7a:  EQUAL  DEPTH  POINTS 
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Figure  7b:  OPTICAL  FLOW  GENERATED  BY  POINTS  WITH 
CONSTANT  DEPTH 
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Figure  7c:  DEPTH  NORMALIZATION  OF  OPTICAL  FLOW 
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Figure  7d:  ISOMETRIC  REPRESENTATION  OF  OPTICAL  FLOW 
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Figure  7e:  ISOMETRIC  REPRESENTATION  OF  DEPTH-  NORMALIZED 

OPTICAL  FLOW 
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Figure  8a:  EQUAL  LOOMING  POINTS 
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Figure  8b:  OPTICAL  FLOW  GENERATED  BY 

equal-looming  points 


-30- 


Figure  8c:  LOOMING  NORMALIZATION  OF  OPTICAL  FLOW 


Figure  8d:  ISOMETRIC  REPRESENTATION  OF  OPTICAL  FLOW 
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Figure  8e:  ISOMETRIC  REPRESENTATION  OF  LOOMING- 

NORMALIZED  OPTICAL  FLOW 


Figure  8f:  LOG  SIN  0 RETINA  (LOOMING) 
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Figure  9a:  EQUAL  CLEARANCE  POINTS 
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Figure  9b:  OPTICAL  FLOW  GENERATED  BY  POINTS  ON  A CYLINDER 
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Figure  9c:  CLEARANCE  NORMALIZATION  OF  OPTICAL  FLOW 
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Figure  9d:  ISOMETRIC  REPRESENTATION  OF  OPTICAL  FLOW 
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Figure  9e:  ISOMETRIC  REPRESENTATION  OF 

CLEARANCE-NORMALIZED  OPTICAL  FLOW 


Figure  9f:  cOT  0 RETINA  (CLEARANCE) 


-39- 


XNHIAHDVTdSIQ  TVIQVH  QHZnVWHON 


ECCENTRICITY  0 IN  DEGREES 


il'f. 


Ml 


m 


»5ti 


'^ir 


I'liy, 


'll 

I: 


I 


I- 

f 

r.g. 


; Ilf, 


w 


\rf 


'■lilj 


•i"i, 


I'l; 


fi 


I' 


r-  r ■ 


tk 


C/'  t 


oo 


hi 


Si 


^ ft 

i'. 


^4*.. 


?r 


44 


s ^ I 

1* 


v'i: 


m 

Uw 

ite 


1*1^.-; 


{(■inMl 

4U 


y*i  '^^  "1 


A>^ 

U4 


-f^r-  1*  *v**AjlCt'! 


r,/i- 


^lik'ivrsED  avoh 


. V „;;j;  . |,i.  ! ' ■■,-  c 


i ST-114A  U.S.  DEPARTMENT  OF  COMMERCE 

! EV.  3-90)  NATIONAL  INSTITUTE  OF  STANDARDS  AND  TECHNOLOGY 

i 

BIBLIOGRAPHIC  DATA  SHEET 

i 

1.  PUBUCATION  OR  REPORT  NUMBER 

NISTIR  4807 

2.  PERFORMING  ORGANIZATION  REPORT  NUMBER 

3.  PUBUCATION  DATE 

APRIL  1992 

1 TITLE  AND  SUBTITLE 

On  Logarithmic  Retinae 

^ AUTHOR(S) 

Daniel  Raviv,  Don  J.  Orser,  and  James  S.  Albus 

• PERFORMING  ORGANIZATION  (IF  JOINT  OR  OTHER  THAN  NIST,  SEE  INSTRUCTIONS) 

U.S.  DEPARTMENT  OF  COMMERCE 

1 NATIONAL  INSTITUTE  OF  STANDARDS  AND  TECHNOLOGY 

1 GAITHERSBURO,  MO  20899 

7.  CONTRACT/ORANT  NUMBER 

a.  TYPE  OF  REPORT  AND  PERIOD  COVERED 

SPONSORSNa  ORQANIZATtON  NAME  AND  COMPLETE  ADDRESS  (STREET,  CITY,  STATE,  ZIP) 


. SUPPLEMENTARY  NOTES 


ABSTRACT  (A  200-WORD  OR  LESS  FACTUAL  SUMMARY  OF  MOST  SIQNIRCANT  INFORMATION.  IF  DOCUMENT  INCLUDES  A SIGNIFICANT  BIBUOQRAPHY  OR 
LITERATURE  SURVEY,  MENTION  IT  HERE.) 

This  paper  suggests  several  iconic  image  “waipings”,  or  lemappings, 
which  facilitate  computationally  inexpensive  measurements  of  moving  3-D 
points  relative  to  a camera.  Assuming  translational  motion  of  the  camera, 
where  the  optical  axis  coincides  with  the  direction  of  motion,  and  a station- 
ary scene,  points  in  3-D  space  that  lie  on  a particular  3-D  surface  produce 
a constant  value  for  some  nonlinear  function  of  the  optical  flow.  This  func- 
tion need  not  be  computed  after  the  image  is  formed,  but  rather  can  be 
implemented  by  hardware  at  the  retinal  level,  i.e.,  via  non-linear  variable- 
resolution  (usually  logarithmic)  retina.  Four  sets  of  different  surfaces  are 
introduced  and  there  is  one  optical-flow-based  constant  value  for  each  sur- 
face. We  call  diese  values  "invariants".  An  invariant,  which  is  a scalar, 
describes  a 3-D  surface.  For  each  invariant  a logarithmic  retina  is  defined 
which  will  cause  otical  flow  on  these  surfaces  to  have  identical  values. 

The  process  of  image  remapping,  called  “normalization  , is  defined 
for  four  1-D  parameterizations  of  space:  range,  depth,  looming  and  clear- 
ance. For  each  invariant  a camera-retina  imaging  model  utilizing  spherical 
projection  and  foveal  peripheral  resolution  is  described  for  analyzing  opti- 
cal flow.  Computer  simulation  demonstrates  how  the  new  suggested 
retinae  normalize  the  optical  flow  with  respect  to  each  one  of  the  parame- 
terizations. 

2.  KEY  WORDS  (6  TO  12  ENTRIES;  ALPHABETICAL  ORDER;  CAPITALIZE  ONLY  PROPER  NAMES;  AND  SEPARATE  KEY  WORDS  BY  SEMICOLONS) 

Visual  motion;  Logarithmic  Retinae;  Computer  Vision 


3.  availability 

14.  NUMBER  OF  PRINTED  PAGES 

UNUMITED 

FOR  OFFICIAL  DISTRIBUTION.  DO  NOT  RELEASE  TO  NATIONAL  TECHNICAL  INFORMATION  SERVICE  (NTIS). 

43 

ORDER  FROM  SUPERINTENDENT  OF  DOCUMENTS,  U.S.  GOVERNMENT  PRINTING  OFFICE, 

15.  PRICE 

~T 

WASHINGTON,  DC  20402. 

AO  3 

ORDER  FROM  NATIONAL  TECHNICAL  INFORMATION  SERVICE  (NTIS),  SPRINOnELO,  VA  22161. 

ELECTRONIC  FORM 


• t. 


TMl  ,' 

-"  ■■'  ’'^.'  ',  ('■.  \, VfJ  -, 

■I . ■ -,.  ..•  -^''-ifej 


wiffivnwa4^>M 


14'^ 


iii«im»»)iitW‘'''"»wi^ 


• . . • .—  : rw  .VIC 


r.  :“s!;a;-rws»w^^ 


■ '-  ■ >M»  ji  ^fl*,.,Rafebm  la>  «*x>5Ma»  ^ 

"luX.^-  tvfj’  .y-Vj^  icsbje  Sili  lo  0W3«|!t.\saifl^^ 

3<.^  m jKtm^  %}; 

j»iv^  .buhii  Sfijfeat  aid^^te 
h iUtif  itxiiaxiSihitj^] 

‘JMtsi5',r  yUW’JlOO 
f li  ^e^nma 

li  'mkiti 

, ►iwUv  9vmdl  oi  asar>jii!»  J!ss^>!ft^r^ 

mi(0  ,$mpm 

.fa(4irJ.4.;.j;^  V^ivat'  ^ -sfci&tJiij.stt-aafef  i!mp<tli)^Bii^i' r»i'ft<«!yyi^)j:^^ 


wiiS5ir^ 


c^-' 

0 CM^ 


'5;-m 


